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METHOD AND SYSTEM FOR MARKING WRITINGS ONLINE 



BACKGROUND OF THE INVENTION 

1 . FIELD OF THE INVENTION 

The present invention relates to education and the data processing task of 
editing electronic texts. More particularly, this invention relates to a system and 
method for evaluating and providing editorial feedback on an electronic writing. 

2. DESCRIPTION OF THE RELATED ART 

For many years, those English teachers who teach compositional writing have 
spent considerable amounts of their work-time in the task of reading, marking and 
grading the essays written by their students. As a means of providing their students 
with as much constructive feedback as possible, this marking process often involves 
teachers inserting their editorial comments into the margins of their students' essays - 
an always time-consuming and often a somewhat repetitive task as a result of the 
similarities in the editorial comments. 

For electronic writings or those composed on computers using word 
processing software, compositional writing students can usually use their software's 
spelling and grammar checkers in an attempt to avoid such errors in their writings. 
While using such checkers may make their teachers' editorial marking and grading 
tasks somewhat easier, such checkers do not do the comprehensive job of evaluating 
usage and punctuation than an experienced teacher can provide. For providing 



feedback on how student essays handle matters such as developing ideas cogently, 
organizing them logically and connecting them with clear transitions, compositional 
writing teachers still must resort to inserting an assortment of editorial comments into 
the margins of such writings. 

There appears to have been few, if any, attempts to address the compositional 
writing teachers overall task of "reading, editorially marking and grading" student 
essays. Instead, previous inventive efforts in this area appear to have been directed 
only to the grading aspects of this task. For example, U.S. Patent No. 6,181,909 
discloses a system and method for automating the grading of essays. It accomplishes 
this by parsing the essay into a syntactic representation of the essay and then grading 
this representation using various specified heuristics. This invention makes no 
attempt to provide a student writer with any editorial feedback regarding specific 
parts of an essay. 

U.S. Patent No. 5,987,302 discloses an online essay evaluation system. In 
general, this system is directed towards many topics of the evaluation process other 
than providing student feedback (e.g., administrative matters, such as billing and 
scheduling of essay readers). The only feedback that this system makes available for 
students consists of generalized rubrics that have been developed for use with essays 
that fall within specified scoring ranges. Feedback on specific parts of the essay are 
not pro\dded, and no attempt is made to return to the student an essay with any 
editorial markings. 

U.S. Patent No. 5,576,955 discloses a method and apparatus for proofireading 
in a computer system. However, it is directed toward use by individual essay writers, 
rather than their teachers. Similar to a spell checker for use by a writer in identifying 
and simultaneously correcting spelling errors in draft versions of their electronic 
writings, this proofireading apparatus attempts to identify and simultaneously facilitate 
corrections for a wider range of compositional writing errors (e.g., spelling, 
punctuation, grammar, usage, broken words, doubled words and capitalization). 

Despite the prior art, there exists a continuing need for new and improved 
methods and apparatus for reducing the editorial workloads of compositional writing 
teachers. The present invention substantially fulfills this need. 



SUMMARY OF THE INVENTION 



The present invention is generally directed to satisfying the needs set forth above 
and overcoming the limitations and problems identified with prior systems and methods 
used by compositional writing teachers in editorially marking and grading their 
students' essays. 

In accordance with one preferred embodiment, the present invention takes the 
form of a method for marking an electronic writing created with a specified word 
processing software and which is displayable with this software on a video display of 
a computer system. This method comprises the steps of (a) developing a set of 
editorial markings for a writing that, when inserted into the writmg, conmiunicates 
information, regarding the portion of the writing in proximity to the marking's 
insertion point, chosen fi-om the group consisting of information on the writing's 
punctuation, capitalization, italicization, grammar, word usage, content or form, (b) 
providing means for displaying the set of markings on the video display, (c) selecting, 
from the set of editorial markings, a marking to be inserted into the writing in order to 
give its writer feedback on the portion of the writing in proximity to the marking's 
insertion point, (d) inserting the markings into the electronic writing at specified 
locations within the writing, (e) saving the inserted markings used in marking the 
writing so as to establish a database that documents the use of the inserted markings 
for the writing, and (f) compiling summary statistics for the saved markings that 
communicate information selected firom the group consisting of information 
pertaining to: (i) specified skills that the writer would need to focus upon in order to 
improve the writer's writing skills, (ii) for a series of the writings by the same writer, 
the writer's progress towards improvement in those areas identified by the markings 
as needing improvement, (iii) for a collection of writings by a group of writers who 
are being instructed as a group, the group's general areas denoted as needing 
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1 improvement by the markings inserted into the collection of writings, and (iv) for a 

2 series of writings by the group, the group' s progress towards improvement in those 

3 areas identified as needing improvement by the markings inserted into the series of 

4 writings. 

5 According to another preferred embodiment, this method for marking an 

6 electronic writing fiirther includes the steps of: (g) developing a means for filtering 

7 the saved markings so that only a specified portion of such markings remain in the 

8 writing when it is returned to its writer, and (h) hyperlinking the inserted markings to 

9 specified websites, on a network of linked computers, having information chosen 

10 from the group consisting of detailed explanations of the markings and exercises that 

1 1 one can undertake in order to strengthen those writing skills which are denoted by the 

12 markings as representing areas in which the writer needs improvement. 

13 A preferred means for implementing the step of selecting a marking to be 

14 inserted into the writing comprises the development of a toolbar that is shown on the 

15 video display as being situated adjacent to the operating screen of the word 

16 processing software. This toolbar contains a group of icons, each of which represents 

17 one of the set of editorial markings. 

18 In accordance with another preferred embodiment, the present invention takes 

19 the form of a computer program product for marking an electronic writing and which 

20 is on a computer readable memory executable by a computer system that operates a 

21 specified word processing software. This product comprises: (a) a set of editorial 

22 markings for an electronic writing that, when inserted into the writing, communicates 

23 information, regarding the portion of the writing in proximity to the marking's 

24 insertion point, chosen firom the group consisting of information on the writing' s 

25 punctuation, capitalization, itaUcization, grammar, word usage, content or form, (b) 

26 means for displaying the set of markings on the video display, (c) means for selecting, 

27 fl-om the set of editorial markings, a marking to be inserted into the writing in order to 

28 give its writer feedback on the portion of the writing in proximity to the marking' s 

29 insertion point, (d) means for inserting the markmgs into the electronic writing at 

30 specified locations within the writing, (e) means for saving the inserted markmgs 

31 used m marking the writing so as to establish a database that documents the use of the 



inserted markings for the writing, (f) means for compiling summary statistics for the 
saved markings that communicate information selected from the group consisting of 
information pertaining to: (i) specified skills that the writer would need to focus upon 
in order to improve the writer's writing skills, (ii) for a series of the writings by the 
same writer, the writer's progress towards improvement in those areas identified by 
the markings as needing improvement, (iii) for a collection of writings by a group of 
writers who are being instructed as a group, the group's general areas denoted as 
needing improvement by the markings inserted into the collection of writings, and 
(iv) for a series of writings by the group, the group's progress towards improvement 
in those areas identified as needing improvement by the markings inserted into the 
series of writings, (g) means for filtering the saved markings so that only a specified 
portion of such markings remain in the writing when it is returned to its writer, and 
(h) means for hyperlinking the inserted markings to specified websites, on a network 
of linked computers, having information chosen from the group consisting of detailed 

explanations of the markings and exercises that one can undertake in order to 

strengthen those writing skills which are denoted by the markings as representing 

areas in which the writer needs improvement. 

The present invention is seen to overcome the limitations of the prior art. It is 

therefore an object of the present invention to provide an improved method and 

system for editorially marking an electronic writing. 

It is another object of the present invention to reduce the time that 

compositional writing teachers spend in the task of reading, marking and grading the 

essays written by their students. 

It is a yet another object of the present invention to provide a method and 

system that allows compositional writing teachers to effectively compile statistics on 

the types of mistakes that their students are making, either as a group or in a series of 

writings by an individual student. 

These and other objects and advantages of the present invention will become 

readily apparent as the invention is better understood by reference to the accompanying 

drawings and the detailed description that follows. 
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1 BRIEF DESCRIPTION OF THE DRAWINGS 

2 FIG- 1 illustrates the toolbars that are used by the computer program 

3 embodiment of the present invention. 

4 FIGS. 2(a)-2(d) illustrate the marking icons and associated standard comments 

5 that are used by the computer program embodiment of the present invention, 

6 FIG. 3 illustrates the "text" and "dialog" buttons that are used by the computer 

7 program embodiment of the present invention. 

8 FIG 4(a) and 4(b) illustrate the "text on" and "dialog on" mode for inserting 

9 markings and comments using the computer program embodiment of the present 

10 invention. 

11 FIG. 5(a) and 5(b) illustrate the "text off' and "dialog on" mode for inserting 

12 markings and comments using the computer program embodiment of the present 

13 invention. 

14 FIG. 6 illustrates the "text off' and "dialog of mode for inserting markings 

15 and comments using the computer program embodiment of the present invention. 

16 FIG. 7 illustrates a "pull down menu" means for inserting markings and 

17 comments using the computer program embodiment of the present invention. 

18 FIG. 8 illustrates a keyboarding means, using an "Annotate By Code" 

19 key, for inserting markings and comments using the computer program 

20 embodiment of the present invention. 

21 FIG. 9(a) illustrates a student's composition that has been thoroughly 

22 marked using the computer program of the present invention. 

23 FIG. 9(b) illustrates the means for enabling a teacher to filter the 

24 markings that will appear in the version of the marked essay that is returned to 

25 the student. 

26 FIG. 9(c) illustrates the filtered version of a portion of the marked 

27 essay seen in FIG. 9(a). 

28 FIGS. 10(a) and 10(b) illustrate how the present invention's inserted 

29 markings may be hyperlinked to websites containing information pertaining to 

30 the inserted markings. 



FIG. 1 1 illustrates the means for displaying some of the statistics that 
may be compiled for the inserted markings of the present invention, 

FIG, 12 illustrates a respresentative computer system on which the 
present invention can be run. 

FIG. 13 shows a block diagram of a representative computer m which 
the present invention can be implemented. 



DESCRIPTION OF THE PREFERRED EMBODIMENT 



For purposes of explanation and not limitation, specific details are set forth 
below, such as computer screen layouts and designs, in order to provide a thorough 
understanding of the present invention. However, it will be apparent to one skilled in 
the art that the present invention may be practiced in other embodiments that depart 
fi*om these specific details. In other instances, detailed descriptions of well known, 
software writing methods, etc, are omitted so as not to obscure the description of the 
present invention with unnecessary detail. 

Referring now to the drawings wherein are shown preferred embodiments and 
wherein like reference numerals designate like elements throughout, there is shown in 
these drawings the various aspects of a method, system and computer program for 
marking an electronic writing. For purposes of illustration, the electronic writing in 
these drawings has been composed using Microsoft; Word 2000 software. However, 
it will be recognized that the elements and steps of the present invention could have 
been just as easily illustrated by electing to use an electronic writing composed with 
any of the other comparable pieces of word processing software. 

The present invention in the form of a computer program for editorially 
marking an electronic writing consists of: a set 10 of editorial markings for insertion 
into the writing, a means for selecting 12 a specific marking 14 for insertion into the 
writing, a means for saving 16 the inserted markings, a means for compiling 18 
summary statistics 20 for the saved markings, a means for filtering 22 the saved 
markings so that only a specified portion of such markings remain in the writing 
when its marked version is returned to its writer, and a means for hyperlinking 24 the 
inserted markings to specified websites that explain the markings and contain 
exercises that one can undertake in order to strengthen those writing skills which are 
denoted by the markings as representing areas needing improvement. 

FIGS, 1 through 1 1 provide a view of the various computer screens that a user 
of this computer program might encounter while using it. FIG. 1 illustrates how the 
means for selecting 12 a marking for insertion into the writing is accomplished by 
having one click on various icons 26 that represent the individual markings and which 



-9- 



1 are presented in toolbars 28 that are displayed adjacent to the word processing 

2 software' s main window 30. In this example, four editing toolbars have been created, 

3 with the icons of each being used for either the insertion of punctuation, usage, 

4 content or form markings. With each of these markings there is also associated a 

5 standard, explanatory comment 32 that may or may not be inserted, along with the 

6 marking, in a student's essay. For example, for a "W" icon that implies a "wordy" 

7 sentence, the standard comment might be "too wordy, simplify this sentence." See 

8 FIGS. 2(a)-2(d) for a listing of these icons and their associated standard comments. 

9 By clicking on one of these icons 26, a teacher can insert a marking and 

10 possibly also a comment directly into a student's essay at the current location of the 

11 cursor in the essay. Such markings and comments can take one of several forms. 

12 FIG. 3 shows "text" 34 and "dialog" 36 buttons that have been created in order to 

13 provide variety in the form of the inserted markings or comments. These buttons are 

14 part of an additional marking toolbar that has been added below the standard toolbars 

15 of the word processing software. By clicking on the "text on" and "dialog off" 

16 buttons, the teacher is able to insert a selected marking and its standard comment. 

17 As shown in FIG. 4(a) and 4(b), by staying in the "text on" mode, and with 

18 the "dialog" button now placed in the "dialog on" mode, the standard comment that is 

19 inserted with the marking can be edited and elaborated upon. This is accomplished 

20 by having a dialog box 38 appear when any marking is selected for insertion. This 

21 box which initially contains the standard comment can be easily edited. 

22 FIG. 5(a) and 5(b) illustrate that in the "text off' and "dialog on" mode, a 

23 dialog box 38 again appears when an icon is selected. However, the dialog box is 

24 initially vacant so that a totally original comment may be inserted with the marking. 

25 FIG. 6 represents the situation in the "text off' and "dialog of mode when only a 

26 marking is inserted. 

27 As shown in FIG. 7, when a user of this computer program needs a 

28 reminder about which comment is represented by a specific icon, they can 

29 quickly consult a pull down menu 40. All the icons of the various toolbars 

30 and their standard comments are accessible from these menus 40. Comments 

31 can also be inserted from the pull down menus. Additionally, by placing the 
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1 cursor over an icon on the toolbar, the standard comment associated with this 

2 comment and its code number are shown in a dialog box that appears on a 

3 user's computer screen. 

4 Those who have good keyboarding skills may prefer to insert their 

5 markings and comments without using the icons and utilizing the click and 

6 point method, FIG. 8 illustrates that this is accomplished by striking the 

7 keyboard's F2 key 42 which causes a dialog box 44 to appear that calls for the 

8 user to insert in the box the appropriate number of the marking to be inserted 

9 into the student's essay. This fonction can also be accomplished by clicking 

10 on an "Annotate By Code" button 46 that has been added to the word 

1 1 processor' s additional marking toolbar. 

12 When a student's composition is thoroughly marked, it can often 

13 display many of these editorial markings and can appear quite threatening to a 

14 student's confidence in their writing skills. See FIG. 9(a). 

15 Since no student wants to see an essay that has been covered with 

16 inserted markings and comments indicatmg problems in his or her writing, it 

17 has proven useful to provide the present invention with the capability to allow 

18 a user to filter the inserted markings before a marked essay is actually 

19 returned to a student. For example, assume that a student has struggled with 

20 his or her "usage" and "punctuation" in a particular essay or series of essays. 

21 In this situation, a teacher might want the student to work on these areas 

22 before addressing "content" and "form" issues. To encourage this, the teacher 

23 has the ability to filter a marked essay so that only the "usage" and 

24 "punctuation" markings appear in the version of the marked essay that is 

25 returned to the student. 

26 To accomplish this filtering process, the present program has been 

27 provided with a "Filter Document" button 48. Upon clicking on this button, a 

28 "Filtering Dialog Box" 50 is opened that enables a teacher to select the 

29 markings and comments that the teacher wishes to be shown on the version of 

30 the marked essay that is to be returned to the student. See FIG. 9(b). All 

31 other markings are filtered, as shown in FIG. 9(c). 



As a means of increasing the instructional value of this computer 
program, the inserted marking may be hyperlinked to various websites on a 
network of linked computers, such as the Internet, that contain an assortment 
of information pertaining to the marking or its associated comments. FIGS. 
10(a) and 10(b) illustrate the use of such hyperlinked, inserted markings. In 
this embodiment, the code for this computer program has been written so that 
when one clicks on an inserted icon the computer's browser is automatically 
launched and one is sent to a specific website having information or 
mstructional exercises pertaining to the marking or its associated comment. 
Such a website can also route students to other websites having interactive 
games and exercises where they can use such materials to improve those of 
their writing skills which are being addressed by the inserted marking or 
comment. 

As an aid to assist a teacher in assessing the progress of an individual 
writing student or class of students, this computer program embodiment of the 
present invention has been provided with code that allows various types of 
statistics to be computed for the markings being inserted. This is 
accomplished by creating a database which documents the insertion of the 
various editorial comments and comments. Within this database, various 
groups of essays may be comparatively reviewed. For example, a teacher may 
elect several essays written during an initial period of time by an individual 
student and then compute the percentage of occurrences of each of the 
inserted markings. These percentages can be compared to similar statistics 
that are compiled for a comparable number of essays written by this same 
student during a later period of time. Such a comparison will reveal if the 
student's initial writing areas needing improvement are actually improving, 
and what, if any, new areas of the student's writing are being indicated by the 
later inserted marking as needing improvement. 

The technique for making these statistics readily available to the 
teacher is shown in FIG. 1 1 . By clicking on a "Display Summary" button 52, 
the insertion percentages for the markings are displayed in a "Summary" 
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1 window 54 that is automatically opened by the program. Additionally, the 

2 code for this computer program can be written such that a particular point 

3 value is assigned to each icon. By summing these point values for the various 

4 markings placed on a student's paper, this computer program can effectively 

5 provide the teacher with a "grade" for a marked paper that is a measure of the 

6 teacher's assessment of the overall quality of the writing. 

7 The present invention also possesses the ability to combine these 

8 statistics for inserted marking with information from other databases in order 

9 to foster a wide variety of studies of student writings skills and habits. For 

10 example, combining these statistics for inserted markings with demographic 

11 data for the student writers may allow for some statistically-based conclusions 

12 to be drawn regarding the types of compositional writing mistakes most 

13 commonly seen in groups of students having specified, similar demographic 

14 backgrounds. 

15 The computer program of the invention may be run on a variety of 

16 computers or collection of computers under a number of different operating 

17 systems. The computer could be, for example, a personal computer, a mini 

18 computer, mainframe computer or a computer running in a distributed 

19 network of other computers. 

20 In FIG, 12, a computer 60, comprising a system unit 62, a keyboard 

21 64, a mouse 66 and a video display 68 are depicted. The screen 70 of video 

22 display device 68 is used to present a graphical user interface (GUI). The 

23 graphical user interface supported by the operating system allows the user to 

24 use a point and click method of input. 

25 FIG. 13 shows a block diagram of a representative computer in which the 

26 present invention is implemented. Such a computer includes a system bus or plurality 

27 of system buses to which various components are coupled and by which 

28 communication between the various components is accomplished. The 

29 microprocessor or central processing unit (CPU) is connected to the system bus and is 

30 supported by read only memory (ROM) and random access memory (RAM) also 

31 connected to system bus. The ROM contains among other code the Basic Input- 
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Output system (BIOS) which controls basic hardware operations such as the 
interaction and the disk drives and the keyboard. The RAM is the main memory into 
which the operating system and application programs are loaded. The memory 
management chip is connected to the system bus and controls direct memory access 
operations including, passing data between the RAM and hard disk drive and floppy 
disk drive. The CD ROM, ^so coupled to the system bus, is used to store a large 
amount of data, e.g., a multimedia program or large database. 

Also connected to this system bus are various I/O controllers: the keyboard 
controller, the mouse controller, the video controller, and the audio controller. The 
keyboard controller provides the hardware interface for the keyboard, the mouse 
controller provides the hardware interface for the mouse (or other point and click 
device), the video controller is the hardware interface for the video display, and the 
audio controller is the hardware interface for any multimedia speakers. An I/O 
controller enables communication over a network to other similarly configured data 
processing systems. 

The computer program embodiment of the present invention may exist 
as a set of iastructions in a code module resident in the RAM. Until required 
by the computer system, the set of instructions may be stored in another 
computer memory, for example, in the hard disk drive, in an optical disk for 
eventual use in the CD ROM or in a floppy disk for eventual use in the floppy 
disk drive. As shown in FIG. 13, the operating system and word processing 
software are resident in RAM. Since the various methods of such operating 
system and word processing software are well known to the art, these methods 
will not be discussed herein in any detail 

The foregoing descriptions of the invention have been presented for purposes 
of illustration and description. Further, the description is not intended to limit the 
invention to the form disclosed herein. Consequently, variations and modifications 
commensurate with the above teachings, and combined with the skill or knowledge in 
the relevant art are within the scope of the present invention. 

The preferred embodiments described herein are fiirther intended to explain 
the best mode known of practicing the invention and to enable others skilled in the art 
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to utilize the invention in various embodiments and with various modifications 
required by their particular applications or uses of the invention. It is intended that 
the appended claims be construed to include alternate embodiments to the extent 
permitted by the current art. 



